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Sh Abstract 

^"^ , The solution to nonlinear Fokker-Planck equation is constructed in terms of the minimal Markov 

' semigroup generated by the equation. The semigroup is obtained by a purely functional analytical method 
via Hille-Yosida theorem. The existence of the positive invariant measure with density is established and 

' a weak form of Foguel alternative proven. We show the equivalence among self-adjoint of the elliptic 

, , operator, time-reversibility, and zero entropy production rate of the stationary diffusion process. A 

' thermodynamic theory for diffusion processes emerges. 

o 

. Key virord: elliptic equation, entropy production, invariant measure, maximum principle, reversibility, 

' strong solution, transition function, weak solution. 

(N : 
o . 

^ ■ Introduction 

I Diffusion processes, as an important part of statistical mechanics, are models for many 

^ ' equilibrium and nonequilibrium phenomena. It is widely considered as a phenomenological 
pH ' approach to systems with fluctuations; however, its relationship to nonequilibrium thermo- 
. ^ ' dynamics is not clear. In recent years, motivated by work on biological macromolecules which 
^ ■ convert chemical energy into mechanical work (molecular motors) [14, 4] , it becomes evident 
. that a thermodynamic formalism, both for equilibium and more importantly nonequilibrium, 

can be developed from a diffusion theory of macromolecules in an ambient fluid at constant 
temperature [17, 19]. This is a natural extension of the dynamic theory of synthetic poly- 
mers which are passive molecules [1]. Molecular motors are nano-scale devices, driven and 
operating under nonequilibrium steady-state with heat dissipation [16]. 

The central elements in the new development are the heat dissipation and the entropy 
production [17]. The essential difference between an equilibrium polymer and a molecular 
motor is that the former has zero heat dissipation and entropy production while for the 
latter they are positive. Introducing these two quantities into a diffusion process makes 
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the stochastic theory a thermodynamic one with the first and the second laws, as well as 
Onsager's theory [13], as logical outcomes [19]. 

Heat dissipation and entropy production also play important roles in the mathematical 
formulations for the stationary noncquilibrium steady-state (NESS) in a computer simulation 
of driven fluids [3]. Numerical observations have led to a surge of mathematical analysis of 
NESS from a dynamical-system point of view [26]; Lebowitz and Spohn also developed 
a theory from a stochastic- process standpoint [10]. Later, the mathematical relationship 
between the entropy production in the diffusion theory and that in the axiom-A system has 
been established [6], and an intimate relationship between Lebowitz and Spohn's approach 
and the diffusion-process based thermodynamics has also been discussed [19]. 

As the foundation for the new statistical thermodynamic theory, the mathematical task 
is to firmly establish the relation between time reversibility and vanishing of the entropy 
production for general diffusion processes. A technical difficulty to be overcome is to rigor- 
ously construct a stationary diffusion process from a given stochastic models in the form of 
a stochastic differential equation 



where £* denotes the adjoint of operator L. Constructing the diffusion process is usually 
accomplished by a probabilistic method based on maringales [27]. Here we provide an al- 
ternative purely functional analytical approach, which enables us to rigorously establish the 
self-adjoint (symmetric and maximum on an appropriate Hilbert space) generator for re- 
versibility. This approach is also more accessible for readers familiar with the mathematical 
physics of quantum mechanics. 

In this paper we study the diffusion process defined by the nonlinear stochastic differential 
equation (1) in which F is a nonsingular matrix and ^(t) is the "derivative" of a n-dimensional 
Wiener process. This equation has wide applications in science and engineering as a model for 
continuous stochastic movement. One standard method for attacking this equation is to find 
the fundamental solution to the Cauchy problem of the related Fokker-Planck (Kolmogorov 
forward) equation (2), which defines the transition probability p{t,x,dy) on the entire M". 
Unfortunately in the theory of partial differential equations the existence and uniqueness of 
the fundamental solution to Eq. 2 imposes very restrictive conditions, i.e., boundness on the 
coefficients A{x) and b{x) [9]. Most of the interesting applications of Eq. 1 could not meet 
the required conditions. One eminent example is the Ornstein-Uhlenbeck process associated 
with Eq. 1 with linear b{x). 

For nonlinear b{x) defined on entire M", in general the uniqueness of the solution to 
Eq. 2 does not hold true. To circumvent this predicament, we shall directly construct 
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the minimal semigroup generated by the Fokker- Planck equation by a purely functional 
analytical method instead of the traditional probabilistic one [27] . The existence of a family 
of transition functions satisfying Kolmogorov- Chapman equation then follows. By finding 
the invariant functional in the non-zero limit case, wc obtain an invariant probability density. 
Hence by this approach we obtain a weak Foguel alternative and a stationary Markov process 
as a solution to Eq. 1. This approach is new, even though a part of the mathematics has 
been in the Chinese literature [20, 21]. We present some of the relevant results here for the 
completeness for english audiences. 

In mathematics, [23] gave the first rigorous result on irreversibility and entropy production 
in the case of discrete-state Markov chains. A comprehensive treatment of this case has been 
published [7]. For a diffusion process with bounded coefficients A{x) and b{x), related results 
were anounced in [24, 25] where Girsanov formula could be used in the proof. This approach, 
however, is not valid for the case of unbounded A{x) and b{x), on M", which is addressed 
here. For linear b{x) in Eq. 1, the mathematical task is significantly simplified and the 
diffusion processes are also Gaussian. The linear case is intimately related to Onsager's 
theory of irreversibility [17]. 

In the following, we assume: 

1) A{x) = {aij{x)}, b{x) = {bj{x)} are smooth; 

2) V • b{x) > Ho, where /xq is a constant; 

3) Uniformly elliptic condition 

n n 
i,j=l 1=1 

where r is a positive constant. 

The paper is organized as follows. In Section 1, we motivate the mathematical definition 
of entropy production rate and time-reversibility by a heuristic thermodynamic analysis, 
based on the concept of entropy and the equation for entropy balance [12]. In Section 
2, we first construct the resolvent operators. Then by applying Hille-Yosida theorem, we 
obtain the semigroup generated by the solution to Kolmogorov forward (Eq 2) and backward 
equations in appropriate Banach spaces ^(M") and (7(1^") respectively. In Section 3, we show 
that the semigroup has a family of transition functions satisfying the Kolmogorov-Chapman 
equation, and prove the existence of the invariant probability density. In Section 4, The 
equivalence among reversibility, zero entropy production rate, and symmetricity of operator 
C is established for general minimal diffusion processes. 

1 The Thermodynamic Formahsm of Diffusion Processes 

This section is heuristic. The most important concepts in thermodynamics are entropy 
and heat. The thermodynamic formalism of diffusion processes provides mathematical 
definitions for these two quantities. The entropy has the well-known definition e[P] — 
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— J^„P{t, x) log P{t,x)dx which is a functional of the probabihty density P{t,x), the so- 
lution to Eq. 2. Let's introduce probability flux 

J = VP(t, x) - b{x)P{t, x). 

The concept of heat is a microscopic one, hence it is an functional of the diffusion tra- 
jectory x{t): W{t) = 2 J^{A~^{x)b{x{s)) o dx{s) where o denotes the Stratonovich integral 
[10]. Therefore, the mean heat dissipation rate (hdr) is the expectation limt^ao E[W (t) / 1] 

— Jjg„ 2b{x)A~^{x)J'dx. For system with detailed balance, W{t) is bounded almost surely. 
Otherwise, it is not. The logarithmic generating function of W{t), 

hm-ilog^re-^^W] 

is convex and possesses certain symmetry, which generalizes that hdr being nonnegative in 
stationary state [10]. 

The rate of the increase of entropy is then e[P] = epr— hdr, where 

epr^ [ 2{jA-\x)j) p-\t,x)dx, hdr ^ I 2A-^h{x) ■ Jdx. (4) 

If the force ^A[x)b{x) = — Vf/(a;) is conservative, then one can also introduce free energy 
h[P] = u[P] — e[P] in which u[P] = U{x)dx is the internal energy and it = —hdr. Then 
h = —epr > with the equality hold ture for the stationary process: This is the second law 
of thermodynamics applied to isothermal processes with canonical ensembles. 

3. For nonconservative F{x) without a potential, the free energy can not be defined. In 
this case, one writes F{x) in terms of Helmholtz-Hodge decomposition: F{x) = — V0 + 7(x) 
where the 7 is directly related to the circulation of the irreversible process [23, 14, 22]. 

In the derivation, we used Eq. 2 and integration by part, assuming no flux boundary 
condition and the matrix A being nonsingular. It's meaningful from thermodynamics point 
of view to identify the first term in Eq. 4 with the entropy production rate, and second term 
with the heat dissipation rate which is the product of force F{x) — {2A~^b{x)) and fiux (J). 
The force in turn is the product of frictional coefficient {2A~^) and velocity b{x). In a time 
independent stationary state, e = 0, and the entropy production is balanced by the heat 
dissipation. The following remarks are in order. 

The entropy production rate and time-reversibility. 
Definition 1 The entropy production rate, epr, of a stationary diffusion process defined by 
Eq. (1) is 

^ J {WlogP{t,x) + 2A-^b{t,x)fA{WlogP{t,x) + 2A-^b{x))P{t,x)dx. 
In the stationary case, P{t,x) = w{x). 

Definition 2 A stationary stochastic process {x{t);t e R} is time-reversible if Vm e N and 
every ti,t2, ■ ■ ■ ,tm & the joint probability distribution 

P{x{ti),x{t2), • • • , X{tm)) = P{x{-ti),x{-t2), • • • , x{-tm)). 
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2 The Minimal Semigroup 



We denote 

C(R") = {bounded continuous function/ (x)}, 

Co(M") = {/ e C(M") I lim|,|^oo fix) = uniformly}, 

||/(a;)|| = sup^gK„ |/(a;)|, 

II • II is the norm on C{W) and Co(M"). 

The conjugate of the Fokker-Planck equation (2) is the Kolmogorov backward equation: 

= cuit,x) = ^J2 - > 0,^ e K") (5) 

i,j=l ' ^ i=l ' 

For the solutions to Eqs. 2 and 5, we have the following theorem: 

Theorem 1. If the coefficients of Eq. 5 satisfy assumptions 1) and 3), then there exists a 
Banach space C{W"-) satisfying Co(M") C ^(M") C C(R"'), and the semigroup generated by 
the solution to the Cauchy problem (2) and (3) with initial data f{x) exists in ^(M"). 

The proof of Theorem 1 are divided into four steps: 

(i) Vn G N (the positive integers), on the bounded domain i?„ = {x e R" | \x\ < n}, solve 
the elliptic equation; 

(ii) VA > 0, construct the resolvent operator R{\) : C(R") C(R"), satisfying V/ e 
C(R"), (A - C)R{\)f = / in R" and ||i?(A)|| < 

(iii) Using R{\), define a Banach space (^(R"), satisfying Co(K") C ^(R") C C(R"); 

(iv) The resolvent operators of C in (^(R") satisfy the conditions of Hille-Yosida theorem. 
Hence we obtain the semigroup generated by £ which is the solution to the Cauchy problem 
(3) and (5). 



2.1 Elliptic Equation in a Bounded Domain 

Lemma 1. Vn e N and \/g G Co(-Bn) {/ G C{Bn) \ f\dBn = 0}; the elliptic equation 

{X-C)u = g (6) 
u{x)\dB„ = (7) 

has a unique solution f G C^{Bn) n Co(S„). 

Proof. This is a well known classic result and there is a purely functional analytic proof 
[28]. Here we give a sketch. aij{x) and bi{x) are all bounded and smooth on the bounded 
domain S„. By a set of inequalities given in [28], p. 420, by Riese' representation theorem 
and Lax-Milgram theorem, it was shown that when A > /lo, a sufficiently large constant, 
the Eqs. (6) and (7) have a solution / G EI^(i?„), where IP is the Sobolev space. Because 
dBn G C°°, the weak solution is just the strong one according to Friedrichs-Lax-Nirenberg 
theory. Thus / G C^{Bn). So when A > /xq, the theorem is proved. 
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Now for A < /Xq. First we choose a Aq > Ho- According to the foregoing, for A = Aq 
there exists the solution of (6) and (7), which is denoted by / = R{\o)g. Since C is elliptic, 
{CR{\o)g){xo) < where Xq is the maximum value point of R{Xo)g. From this we can easily 
prove that 

^(Ao): Co(S„)^Co(S„)nC2(S„), ||^(Ao)||<f. 

Thus, when |Ao - A| < p(^, ^(A) = T.n=oi^o - A)"(^(Ao))"+^ is well defined. Xo - C can 
always be extended to being a close operator. Therefore, when |A — Ao| < jj^^^;^) 



(A - C)RiX)g = [(Ao - C) - (Ao - A)] ^(Aq) + 



9^9- 



Hence, R{X)g is the solution of (6) and (7). Finally, since ||/?(Ao)|| < we have |A — Ao| < 
|Ao| < jj^(3^? for VO < A < Aq. Thus, for VO < A < Aq, g & Co{Bn), the solution of the Eqs. 
(6) and (7) exists. 

By the maximum principle of elliptic equation, we could conclude that the solution is 
unique. □ 

2.2 Resolvent Operators 

First, choose a sequence of smooth functions : M" ^ M 



9n(x) = 



^ ij"2 fn{t)dt 



n mdt 



where 

fn{x) 



else 



We can show that gn G C^(M"), and < < 1, g(„ 



= 0. Then, VA > 0, 



= 1, 9n 

using {gn}'^=i-, we define a sequence of linear operators Rn{X) on C(M"). V/ G C(]R"), the 
supp(/5i„), the closure of the domain of x where f{x)gn{x) ^ 0, is in S„ since supp(gi„) C S„. 
So according to Lemma 1, the elliptic equation 

{X- C)u ^fgn in -B„ 

u\dBn = 

has a unique solution Un G C'^{Bn) fl Co(-B„). Thus we can define 



Rn{X)f = 



Un in Bn 
else. 



Furthermore, according to the maximum principle of elliptic operator (c.f. the proof of 
Lemma 1), we have that Rn{X) is a positive operator and ||i?„(A)|| < j. 
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Lemma 2. VA > 0, / e C(]R"), {Rn{X)f}^^^ converge to a function f, satisfying (A — jC)f 

Proof. 1) we first prove the lemma when / > 0. 

First, V m, n e N, m > n, Rm{X)f and it!„(A)/ satisfy the following equations respectively, 

(A - C)Rm{X)f = /5r„i in 
-Rm(A)/|aB^ = 0, 



and 



(A - /:)i?,(A)/ = in 
Rn{\)fW = 0. 
Since Qm > 9n and / is positive, RmW satisfies: 

(A - C)Rm{\)f = fgm > fg-a in B, 



Rm{^)f\dB„ > = fgn\dB„- 

Using the maximum principle of elliptic equation, the inequality in (8) yields 

Rm{X)f\B^ > Rn{X)f\B^. 

Thus, Rjn{X)f > Rn{X)f, i.e. and i?„(A)/ increases with n. Since {i?„(A)}^ have a uniform 
boundary j, lim„_KX) i?„(A)/ exists. Let us denote / = lim^^oo -Rn(A)/. 

We now need to prove / G C^(R'^) and satisfies the equation (A — £)/ = /. According 
to the property of Rm{\)f,\/i^ e C^{Bk) (where k is any positive integer), the following 
equation holds: 

/ fgm^dx^ [ {{X-jC){Rm{X)f))vdx^ I i?^(A)/((A - £*)^)dx 

in which fgn ] f, Rm{X)f t / as n — > oo and /, / are bounded. According to the dominated 
convergent theorem, we have 



J f^dx = J f{{x-n^)dx. 



Therefore / is a weak solution of elliptic equation [X — £)u = f. Because dBk G C°°, 
and / G C(]R"), the weak solution is also the strong solution. So G C'^{Bk) and 

(A-£)/|b, = /|i.,. 

We now let A; ^ oo, then / G C2(M"), and (A - £)/ = /. 

2) Using the above result for positive /, now consider V/ G C(]R"). There exists /+ = 
max(/, 0), /- = max(-/, 0) such that / = /+-/"; /+, f G C(R"). The linearity of i?„(A) 
leads to Rn{X)f — Rn{X)f^ — Rn{X)f~. Since i?„(A)/"'" and it!„(A)/~ have respective limits 
R{X)f+ and R{X)f-, Rn{X)f has limit R{X)f+ - R{X)f-, and 

(A - JC)(R(X)f+ - R(X)f-) ^f+-r^f. 

Therefore, we can define R{X)f = R{X)f'^ — R{X)f~ and complete the proof of Lemma 2. □ 



7 



Lemma 2 allows us to define R{X)f = /. According to the proof of the lemma, the 
following three properties are all evident. 

Proposition 1. VA > 0,R{X) : C(R") has the following properties: 

1. -R(A) is a bounded linear operator on C(M"') and ||i?(A)|| < j, 

2. R{\) has its null space = {0}; 

3. R{\) is positive, i.e. / > implies R{\)f > 0. 

Remcirks: According to Dini theorem [8] , we could conclude that i?„(A)/ uniformly converge 
to R{X)f on any bounded domain. This fact will be useful later. 

2.3 Banach Space ^(E") 

Using R{X), we now define C{W). First, 

H ^span{R{Xi)---R{Xs)f \ Ai, • • • , A, > 0, s e N, / e Co(M")}; 

then 

C{R") = H{dosure in norm \\ ■ \\ of C(R")). 

Lemma 3. VA > 0, R{X)\c(j^r.) : C{W) C{W), and Co(M") C C{W) C C{W). 

Proof, i) If / e H, then according to the definition of H, R{X)f e H. V/ e C{W), 
there exists fi G H, \\f — ^ 0, as i — >• +oo. Because R{X) is a bounded operator, 
||i?(A)/ - R{X)fi\\ ^ as i ^ +00. Thus R{X)fi e C{W) leads to R{X)f e C{W). 

ii) Co(M") C ^(M") C 

V(7 G C^(M"), and with a compact support, /?„(A)(A — = g when n is sufficiently 
large. So ^ = i?(A)(A - G i/. Since C^f (R") = Co(M") and ^(M") = we have 

2.4 Solution to Kolmogorov Equation 

First, we prove -R(A) has the resolvent property, then we can define T>{jC) = i?(A)C'(M") 
which is independent of A. 

Lemma 4. V/ G Ai, A2 > 0, i?(Ai)/ - i?(A2)/ = (A2 - Ai)i?(Ai)i?(A2)/. 

Proof. Similar to Lemma 2, we only need to prove the result when / > 0. 
1) First we show when A2 > Ai > 0, Vn G A'", 

U{X2 - Ai)i?„+i(Ai)i?„+i(A2)/ > RniXl)f - Rn{X2)f > (A2 - Ai)i?„(Ai)i?„(A2)/. 

According to the definition of Rn{X), (A2 — Ai)-R„+i(Ai)-R„+i(A2) satisfies the equations 

r (Ai - £)((A2 - Ai)i?n+l(Al)i?n+l(A2)/) = (A2 - Ai ) ( A2)/)^n+l W 

\ {X2 — Xi)Rn+i{Xi)Rn+i{X2)f\dB„+i =0; 
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(A2 — Ai)i?„(Ai)i?„(A2) satisfies the equations 

{\2-\l)Rn{\l)Rn{\2)f\0B^ =0; ^ ' 

-Rn(Ai)/ — i?n(A2)/ satisfies tlie equations 

{\l-C){Rn{\l)f -Rn{X2)f) = (A2 - Ai)i?„(A2)/ iu Br, 
(RniXl) - Rn{X2))f\dB„ =0. ^ ' 

Using the maximum principle of eUiptic equation, from (9), (11), 5'n+i|B„ = 1, and i?n+i(Ai)i?„+i(A2)/|aB„| 
> 0, we have 

(A2 — Ai)i?„+i(Ai)i?„+i(A2)/ > i?n(Ai)/ — i?„(A2)/; 
from (10), (11), and < < 1, we have 

Rn{Xl)f - Rn{\2)f > (A2 - Ai)i?„(Ai)i?,(A2)/. 

Thus, 

(A2 - Ai)i4+l(Ai)i?„+i(A2)/ > Rn{Xl)f - Rn{X2)f > (A2 - Xl)RniXi)RniX2)f. 

2) Now A2 > Ai, taking hmit of the increasing sequence, we have hm„^oo -Rn(Ai)i?n(A2)/ 
= R{Xi)R{X2)f. On one hand, VA > 0, n e A^, Rn{X)f < R{X)f, so i?n(Ai)i?„(A2)/ < 
Rn{Xi)R{X2)f < RiXi)R{X2)f. (i?„ (A) and i?( A) are all positive.) Thus lim„^ooi?„(Ai)i?„(A2)/| 
< R{Xi)R{X2)f. On the other hand, ^ £ e N, when n > i, Ri{Xi) Rn{X2) f satisfies the equa- 
tion 

(Ai-£)(i?,(Ai)i?„(A2)/) ^{Rn{X2)f)gi in B, 
{Re{Xi)Rn{X2))f\dB, =0; ^ > 

R£{Xi)R{X2)f satisfies the equations 

iX^-C){Re{X^)R{X2)f) = {R{X2)f)gt m B, 
{R,{X,)R{X2))f\aB, = 0. ^'"^ 

According to the remark after the proof of Lemma 2, in B^, {Rn{X2)f)g£ uniformly converges 
to {R{X2)f)g£- Again using maximum principle of elliptic equation, from Eqs. (12) and (13), 
we have 

\Ri{Xi)Rn{X2)f{x) - Re{X,)R{X2)f{x)\ ^0, n^oo. 
Since Ri{Xi)Rn{X2)f < -Rn(Ai)-R„(A2)/ where n > i, there exists 

Re{Xi)R{X2)f < lim RjX,)RniX2)f. 
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Let £ — > oo, 

R{Xi)R{X2)f < lim RjX,)RjX2)f. 

n— »oo 

Therefore, for A2 > Ai, 

lim Rn{X,)Rn{X2)f = R{X,)R{X2)f. 

n-*oo 

From 1) and 2), 

(A2 - Xi)R(Xi)R(X2)f = lim (A2 - Ai)i?„(Ai)i?„(A2)/ = i?(Ai)/ - i?(A2)/. 

n— >oo 

When Ai > A2 the same is true. □ 
Prom Lemma 4, V/ e C{W), Ai, A2 > 0, 

i?(A2)/ = i?(Ai)/ - (A2 - Ai)i?(Ai)i?(A2)/ 

= i?(Ai)(/ - (A2 - Ai)i?(A2)/) e R{X,)C{W'). 

So R{X)C{W) is independent of A. Now we can define the domain of C: V{C) = R{X)C{W). 

We now show that the operator C on C(M'^) satisfies the conditions of Hille-Yosida theo- 
rem, and complete the proof of Theorem 1. 

Proof. (1) V{C) is dense in C{W). Obviously H C V{C), and H is dense in C{W). So 
V{C) is dense in C{W). 

(2) VA > 0, i?(A)(A - C) = E\j,{c), (A - C)R{X) = E\^^^„y where E is the identity 
operator. To prove this, taking any / G T>{C), according to T>{C) = R{X)C{W^), there exists 
g e ^(M"), / = R{X)g. Thus R{X){X - C)f = R{X){X - C)R{X)g = R{X)g = f. Then 
i?(A)(A — C) — E\x>(^c)- (A — jC)R{X) — -E'|(5(]Rn) is a conclusion of Lemma 2. 

(3) II /2(A) II < this is the result of Proposition 1. As the inverse of the bounded operator 
R{X), C is close. 

So the conditions of Hille-Yosida Theorem are all satisfied. □ 

RemEirks: It is easy to verify from the construction process that the solution obtained here 
is the minimal one. Uniqueness actually does not hold true for general aij(x) and bi{x). 
Denoting the semigroup obtained by T(t), the solution of Kolmogorov-backward equation is 
T{t) f. Next we continue to discuss Kolmogorov forward equation and the relation between 
the two sohitions. 

Theorem 2. // the coefficients of Eq. (2) satisfy the assumptions 1), 2) and 3) in Intro- 
duction, then there exists a Banach space C(M"), satisfying Co(M") C (^(M'^) C C(M"), and 
\/g e C(M"), the solution of the Cauchy problem (2) and (3) with initial data g(x) exists in 
C{W), which is denoted by f{t)g. Furthermore, \/f,ge Cq{W) 

j {T{t)f)gdx = j f{f{t)g)dx. (14) 



10 



Proof. One notices that C*u contains a term V • so the assumption 2) in Intro- 

duction is required to ensure that we can take C* as well as C into our consideration. For C* 

we can repeat the steps in the proof of Theorem 1: defining the corresponding Rn{X), R{\) 
and T{t). We only need to prove (13). i?„(A)/ and Rn{X)g satisfy the following equations 
respectively. 

r {\-C)Rn{X)f ^fgn in 



f (A - C*)Rn{X)g = ggn in 5„ 

\ Rn{X)g\dB„ =0. 

Then 

J fgnRn{X)gdx ^ Jj^ fgnRn{X)gdx 

= c)RMf)RniX)gdx 

= lBS^ri{X)f)ggndx 
= J{Rn{X)f)ggndx 

Let n — > oo, J f{R{X)g)dx — J {R{X)f)gdx. According to the theory of Laplace transfor- 
mation and the continuity of T(t) and T{t) , we have 

j f{f{t)g)dx = J {T{t)f)gdx. 

□ 



3 Construction of Stationary Markov Process 

In this part, we prove the semigroup constructed in Section 1 has a family of transition 
functions satisfying Kolmogorov-Chapman equation. Then through the invariant functional, 
we find the invariant probability density. In the end, for a general diffusion operator, we 
obtain its minimal stationary Markov process. We first state a simple but important property 
of the semigroup. 



3.1 Transition Functions 



Lemma 5. T(t) constructed in Section 1 is a positive semigroup. 

Proof. We know R{X) is positive (Proposition 1). So the lemma can be simply concluded 
from the relation between T{t) and R{X), T{t) = limA^oo e'^^e^^"^^^^ f . □ 

Having Lemma 5, when setting to and fixed, we define a positive linear functional 
At,{xo) on C{W), Ato(xo): C{W) ^ R, At,{xo)f^T{to)f{xo). Restricted on Co{W), 
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■^to(^o)|co(K") is also a positive functional. According to the Riesz representation theo- 
rem, there exists a regular measure p{to,XQ,dy), such that V/ e Co(I^"), ^to{^Q)\co{M7>-){f) — 
J^„p{to,Xo,dy)f{y). 

Thus, we have the following Lemma. 

Lemma 6. Vt > 0, x G R", there is a regular measure p{t,x,dy), satisfying: 

1) T(t)f(x)=Jpit,x,dy)f{y), V/ G CoiW'); 

2) Setting T E B, a Borel field generated by M", p(t, x, T) is a Borel measurable function. 

Proof. We have proved the existence of p(i, x, dy) and 1). We refer to [2], p. 159, for the proof 
of 2). □ 

Because every / in C'(]R"') is bounded, any in £^(M") can be immersed into ((^(M"))* 

by 

i:C{W^)^{C{W^)r- V^g£(M"), /G(7(M"), i{^){f) ^ j f^dx. 

Noticing this and identifying i{ip) with </? in the following, we have 

Theorem 3. The transition functions satisfy the Kolmogorov- Chapman equation 

p(t + ...,r)=/p(M,d.)p(....r) a.e. 

Proof. In Co(M"), we have 

T{t)f{x)^ j p{t,x,dy)f{y). 

So V/ e Co(M"), ip e £i(M"), 

T*(OH(/) = Jmf^dx 



p{t,x,dy)f{y) j (p{x)dx 

p{t,x,dy)ip{x)dx^ f{y) (Fubini theorem). 
So 

T*{t){i{ip))^ J p{t,x,dy)<p{x)dx, 
where T*{t) is the conjugate operator of T{t) in (C'(M'*))*. Then V/ G ^(M"), 
{T*{t)ip){f) = [ ( [p{t,x,dyMx)dx]f{y)dy 



p{t,x,dy)f{y) ] cp{x)dx 
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So 



and 



J {T{t)f)ipdx = J J p{t,x,dy)f{y)(p{x)dx, 

T{t)f{x) = Jp{t,x,dy)f{y) a.e. yfeCiW). 

From this result, we can prove Kolmogorov-Chapman equation. Because T{t) is a semigroup, 
T{t + s)f = T{t){T{s)f) V/ e C{R^). 

Jp{t + s, X, dy)f{y) =T{t){J p{s, x, dy)f{y)) 

j P{t,x,dz) j p{s,z,dij)f{y) 
= / {jp{t, X, dz)p{s, z, dy)f{y)) . 

Since / is arbitrary. 



p{t + s,x,dy)= I p{t,x,dz)p{s,z,dy) a.e. 



□ 



Corollary 1. Taking the indicator of B^: 

J ^BnPit, X, dy) < J gn+ip{t, X, dy) 
^T{t){gn+i) 
< 1. 

Let n — > OO; we have 

p{t,x,dy) < 1. 



Corollary 2. ForT{t), there also exists a family of measure p{t,x,dy), satisfying the same 
property as p{t, x, dy); and 

p{t,x,dy)dx = p{t,y,dx)dy. (15) 
Proof We only prove (15). Theorem 2 states that V/,^ e C^(M") 

J {T{t)f)gdx = J {f{t)g) fdx. 

Thus, 

J J P{t,x,dy)f{y)g{x)dx = J J p{t,y,dx)g{x)f{y)dy. 

Since / and g are arbitrary, we have 

p{t, X, dy)dx = p{t, y, dx)dy. 

□ 
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3.2 Invariant Functional 

In the following, we aim at the existence of an invariant probability density. The tast is 
made easier by an indirect approach: We first construct an invariant functional, and using 
its Riesz representation we arrive at the final goal. 

Lemma 7. (^(M") is a separable space. 

Proof. According to the definition of (7(]R"). 



C(R") = span{R{Xi) ■ ■ ■ R{Xs)f \ Ai, • • • , A, > 0, s e TV, / e Co(K")} 
we prove that 

= span{R{X,)---R{Xs)f \ Ai, • • • , A, e Q+, s e TV, / e Co(M-)} 

where Q is the set of rational number. Then the separability of ^(R") becomes obvious from 
the separability of Co(M"). 

Noting the Lemma 4 in Section 1, R{Xi)f-R{X2)f = (A2- Ai)i?(Ai)i?(A2)/, V/ e ^(R"), 
we have 

\\R{X,)f - R{X,)f\\ < \X,-XMX^)\\\\R{XMf\l 
As R{X) is a bounded operator and is dense in M"*", 

span{R{Xi)---R{Xs)f \ Ai, • • • , A, e Q+, s e AT, / e Co(R")} = C{W). 
So ^(R") is separable. □ 

Theorem 4. If j; T(t)f(x)dt does not converge to for every f G Co(M"), x G R", then 
there exists a positive linear functional A on C{M.'^), which is invariant under T(t): K(T(t)f) 
— A(/). And corresponding to K, there is a regular measure 6{dx), satisfying 

j T{t)f{x)e{dx) < J f{x)9{dx) f G Co(R"), / > 0. 

Furthermore 9{dx) has a density 9{x) > 0. 

Proof. The proof consists of four parts: 

1) According to our assumption, there exists /o G Co(R"), and Xq G R" 



limt-^^- I T{s)fo{xo)ds 7^ 0. 
Jo 

We could assume that /o > (or we can substitute /q^ (/q") for /o). Then there exits tn, 
t„ — > 00, as n — > 00, such that 

1 /■*" 

lim — / T{s)fo{xo)ds = a > 0. 
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The separability of ^(R") provides us a sequence of functions {fn}n=ii which is dense in 
^(M"). Because ||T(s)/(a:) || < ||/||, T(s)/fc(x) have a bound independent of s. Using the 
critical Cantor-diagonal method, we could choose a subsequence of tn, which is still denoted 
by tm, such that \/fk 

1 

lim — / T{s)fk{xo)ds exists. 
tm Jo 

Having {fk}k=i dense in C{W), we get V/ e C{W) 

1 

lim — / T{s)f{xo)ds exists. 

k-*oo tnf. Jo 

Now define A: C{R") R 

A(/) = hm — / T{s)f{xo)ds. 

''^'^ tnu Jo 

The assumption makes sure that F is not zero and it is straightforward to prove that A e 

(C'(M'^))*, and |A(/)|< 11/11 \JfeC{W). 
2) A(r(t)/) = A(/) V/eClE"). 



A(T(t)/) = hm — / T{s){T{t)f){xo)ds 
fc— >oo Jq 

= lim — / T{s + i)/(xo)ds 
= hm — / r(s)/(xo)ds 

— / r(s)/(xo)ds+ / T{s)f{xo)dsi- / T(s)/(xo)ds 

^n, \Jo Jtn^ Jo ^ 

/;7+*T(s)/(xo)d. <t||/||, J^T{s)f{xo)ds <t\\f\\, 

AiT{t)f) = hm — / T{s)fixo)ds = A(/). 

3) Restricted on Co(M"), A|Q,(Kn) is still a positive linear functional on Co(M"). According 
to Riesz representation theorem, there exists a regular measure 6* (da;), such that 



Since 



A(/) = / fix)eidx), V/ e CoiW")- 



Now V/ e Co{W), / > 0, we have {T{t)f)gn e Co(K")- {gn is defined in the Section 1.2), 
and 



A((r(0/)5„) = j (T(t)f)gJ(dx). 
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As 1, and A is positive, we have 

HT{t)f) > lim A{T{t)fgn) = I T{t)fe{dx). 

n—*oo J 

Prom 2), A(T(t)/) = A(/) = / fe{dx), we get / T(t)fe{dx) < J fe{dx), wheref e Co(R'')- 

4) 9{dx) has a density 9{x) > 0. 
As A is an invariant functional, using R(X) = e-^^T{t)dt and the method in [9], we have 

AA[i?(A)/]=A(/), V/e(7(M"). 

And from R{X){X-C)f = f,^f e C^{W), take A = 1, we have A(£/)=0, and / CfO^dx) = 
0. So 9(dx) is the weak solution of C*9 = in the space 'Dq{W'') of generalized functions. 
According to Schwartz- Weyl lemma, there exists an infinitely differentiable function 9{x) G 
C\W'), such that 9{V) = J^9{x)dx. 

Because A 7^ 0, 9{x) > 0, using the strong maximum principle of elliptic equation, we 
have 9{x) > 0. □ 



Corollary 3. V/ G Co(M") 

T{t)f9{dx) = J (^Jp{t,x,dy)f{y)^9{dx) 



I 

= /(yp(,x.d,).(dx)j/(,) (FuMn. Tkeorem) 

< j nmiy)- 

Since 9{dy) is regular and f is arbitrary, we have 

J pit,x,dy)9{dx)<9{dy). 

3.3 Invariant Probability 

In the following, we prove 9 is just the invariant density 

Jpit,x,dy)9{dx)^9{dy). 

First, wc define e(t, x) = J p{t, x, dy). As p{t, x, dy) is a finite measure on W^, e{t, x) is well 
defined and we have the following property oi e{t,x). 

Lemma 8. e(t,x) decreases as ^ — > 00. 

Proof. According to the Kolmogorov-Chapman equation. 



p{t + s, X, dy) = J p{t, X, dz)p{s, z, dy). 
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When s > 0, 

e{t + s,x) = J p{t + s,x,dy) 

^ J Jp(t,x,dz)p(s,z,dy) 
< J p{t, X, dz) (Corollary 3) 
= e(i, x). 

Thus, e(i + s) < e(t,x). □ 

Now we define e{x) = limt^oo a;) G M". 

Lemma 9. / p{t, x, dy)e{y) = e{x) \/t > 0, x & R"'. And under the condition of Theorem 4, 
e{x) > and satisfies C*e = 0. 

Proof. 1) / p{t,x,dy)e{y) — e{x). 
According to definition, 

e{t + s,x) — J p{t + s, X, dy) — J J p{t, x, dz)p{s.z.dy) (Theorem 3) 
= J p{t,x,dz)e{s, z). 

Let s — > oo, e{x) = J p{t,x,dz)e{z) (Levi theorem [8]). 

2) e{x) > and e{x) ^ 0. 

It's obvious that e{x) > 0. Now wc assume e{x) = 0. From T{t)f(x) — J p{t,x,dy)f{y) 
V/ G Co(M"), if ||/(a;)|| < 1, then T{t)f{x) < e{t,x). So the assumption that e{x) = 
leads to T(t)f{x) — >■ 0, as t ^ oo G M", which contradicts the condition of this lemma. 
Therefore e(x)^ 0. 

3) jCe{x) = 0, e{x) > 0. 

In the Corollary 2, we have proved p{t, x, dy)dx — p{t, y, dx)dy. So 



J e{x){f{t)g{x))dx = j e{x) j p{t,x,dy)g{y)dx 

^ J J (^i^)9{y)p{t,x,dy) 
— J 9{y)^{y)^y (Fubini theorem). 
According to the relation between T{t) and -R(A), we have 

A / e{x){R{X)g{x))dx — / g{x)e{x)dx. 



So 

e{x)C*gdx — 0. 



Thus e{x) is a solution of Cu = in the generalized sense. And the same reasoning as for 
9{x) leads to e{x) being infinitely differentiable and e{x) > 0. □ 
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Theorem 5. Under the conditions of Theorem 4, d{x) is invariant under T(t). 

Proof. Prom the part 1) of Lemma 9, J p{t,x,d.y)6{x)e{y)d.x — J 9{x)e{x)dx, e{x) > 0, and 
J p{t,x,dy)9{x)dx < 0{dy), we have 

J p{t, X, dy)9{x)dx = 9{dy) \/t > 0, xeW 

Which means 9{dx) is invariant under T{t). □ 

Now, we have proved that T{t) has a family of transition functions p{t,x,dy), and an 
invariant measure 9{dy). Thus we can construct a stationary Markov process by Kolmogorov 
theorem, whose transition probabihty functions are {p{t,x,dy)} and the initial distribution 
is 9{dx). 

Corollary 4. Theorem 4 and 5 together actually shows a weak form of the Foguel alternative 
given in [9] where diffusions with hound coefficients A{x) and h{x) are considered. 



4 Reversibilty and Entropy Production 

With the defintions for time-reversibility and entropy production rate, we establish the 
following equivalence for the diffusion process we constructed. 

Theorem 6. For the stationary process constructed in Section 2, the following three state- 
ments are equivalent: 
(i) The process is time-reversible; 

(a) Its corresponding elliptic operator C* is symmetric on C^{M.^) with respect to a positive 

function w~^{x) ,w{x) G L'^(W^), i.e., f^„w{x)dx < oo; 
(Hi) The process has zero entropy production rate (epr). 

Proof, {i) =^ {ii). 

The proof of this result for a discrete state Markov process is due to Kolmogorov. According 
to the definition of reversibility, we have V/1, B E B 

I I p{t,x,dy)9{y)dx^ / / p{t,y,dx)9{x)dy, 
Jb J a J a Jb 

/ / XA{^)pi't,x,dy)xB{y)0{y)dx = / / XA(?/)p(^>Z/>dx)x^(x)^(x)dy. 
JbJa JaJb 

By the standard method in probability, we have 

/ / <i){x)p{t,x,dy)i/j{y)9{y)dx= / / ^|J{y)p{t,y,dx)(|){x)9{x)dy (16) 
Jb J a J a Jb 

where 0(x), ip{x) G C^(]R"). Noting the definition of T{t), we differentiate both sides of 
(16) with respect to t at t = 0, we have 

/ <l>(x)jC*[9(x)^(x)]dx ^ f i;(y)C*[9(y)<l>(y)]dy. 
Jm" 
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Let f{x) = 6{x)(f){x) and g{x) — 9{x)il){x), then / and g are two arbitrary functions in 
Co°°(M"). Since 9{x) > 0, 

/ e-\x)f{x)C*[g{x)]dx= [ e-\y)g{y)C*[f{y)]dy. 

Therefore, the operator C* is symmetric with respect to the reciprocal of its stationary 
distribution 9{x): w{x) — 9{x). This result is known to physicists. 

iii) =^ {iii). 

The differential operator C* can also be rewritten as 

£V = • {AVf) + (V/) ■ h{x) + /V ■ h{x). 

The statement {ii) is 

j e''g{x)a[f{x)]dx = j e'^f{x)a[g{x)]dx, 

in which the positive w{x) — e~^, / and g e C^(M") are arbitrary functions. This leads to 

j e^'g Qv • (AVf) + (V/) • b(x)^ dx ^ J e^/ Qv • (^V^) + (V^) • b{x)^ dx. 

Through integration by part, the first term on the left-hand-side (and similarly for the right- 
hand-side) 

J e^gV ■ {AVf)dx = - J e^{Vg)A{Vf)dx - J e^g{VU)A{Vf)dx, 
and we have 

/ e^'g Q(Vt/)A(V/) - (V/) • b{x)^ dx = j e^/ Q(Vt/)yl(V/) - (V^) • b{x)^ dx. 

By a simple rearrangement, we have 

J e^(^V/ - fVg) ■ {^AVU - b{x))dx = 0. 

Since / and g are arbitrary, we have ^AVU — b{x) = in which U = — logw. Therefore 

W \ogw{s) + 2A~H{x) = 0, 

which means epr=0. 
(Hi) ^ (i). 

The statement epr=0 leads to ^A'V9(x) + b(x)9(x) — and we know 

C9^V ■ilAV9 + b{x)9)^0. (17) 
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Under these conditions, the operators Rn{X), -R(A), Rn{^), R{^) have the following properties: 
First, eRn{X){i^) = Rn{X){exlj), where ip e C^{W). This is becasue 

/:*{0Rn{X)m = lev ■ Av{Rn{X)m - eb{x) ■ v{Rn{X)m 

+|i?„(A)(V')V • AV9 + Rn{X){^)b{x) ■ VO + i?„(A)(V')^V • h{x) 

+v(i?n(A)(V')) ■ Awe + 2ew{Rn{\)m ■ K^) 

= ec{Rn{x){ip)) + Rn{x){ip)c*{e) + (v • Rn{ip)){Ave + 2eh{x)). 

Equations (17) leads to 

c{eRn{xyilj) = ecRn{X){iij). 

Thus 9Rn{X)ip satisfies 

(X-C*){9Rn{X)^lj) =e(A-£)i?„(A)(V') = ^V^n in 
eRn{X)meB^ =0. 

According to the uniqueness of the solution in S„, 

eR,,{x){ij) = R^{x){e^). (18) 

Second, from (18), V(^, ^ e C^{W) 

J ipgnRn{X){Oip)dx = 'ipgnORn{X){ip)dx 

= //(A - /:*)^„(A)(^^)i?,(A)(<^)dx 
= /^;^„(A)(^^)(A-£)(i?„(A)((^))dx 
= /B„^n(A)(V'^)v'^nda; 
= /b„ -Rn(A)(V'6')(^5(„da;. 

Let n — > oo, since ip, (p are compact supported, 

J ipR{X){9^)dx = J ^R{X){9ip)dx. 

According to the theory of Laplace transformation, from the fact that ipT{t){9(p), and 
(pT{t){9ip) are continuous with t, we have 



J ipf{t){9(p)dx ^ J (pf{t){9ip)dx. 



This leads to 



J J ^{x)P{t,x,dy)9{y)ip{y)dx^ J J ip{y)p{t,y,dx)9{x)psi{x)dy. 
The standard method of measure theory leads to 



p{t,x,dy)9{y)dx = / / p{t,x,dy)9{y)dx 

J A .IB JbJa 

which means reversibility. □ 
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Remcirks: The symmetric operator in (ii) is also maximum on an appropriate Hilbert space 
constructed from C(R'^); hence it is self-adjoint. 

We have now come to the conclusion of this work in which we have provided the general 
diffusion processes defined by nonlinear stochastic differential equations (1) with a sound 
thermodynamic structure. We have introduced two fundamental physical concepts, time- 
reversibility and entropy production, and have shown the equivalence between the reversibil- 
ity and zero entropy production. We have established mathematically the essential properties 
of fluctuating isothermal equilibrium systems. In a separated report, we shall resume the 
investigation on the asymptotic property of the diffusion processes we constructed and a 
strong form of Foguel alternatives for the general diffusion equation. Similar results for the 
restrictive case of linearly increasing aij{x), and bi{x) have been given in [9], which takes 
the advantage of the existence of the fundamental solution. Finally, in a recent work on 
certain non-Markovian Gaussian processes [15], it has been suggested that the equivalence 
between time-reversibility and equilibrium requires some additional conditions. A rigorous 
mathematical treatment of this problem remains to be developed. 
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